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Abstract 

We study natural quantizations of branching coefficients corresponding to the restrictions of the 
classical Lie groups to their Levi subgroups. We show that they admit a stable limit which can be 
regarded as a g-analogue of a tensor product multiplicity. According to a conjecture by Shimozono, the 
stable one-dimensional sum for nonexceptional afhne crystals are expected to occur as special cases of 
these g-analogues. 

1 Introduction 

The Kostka coefficients and the Littlewood-Richardson coefficients which have many occurrences in the 
representation theory of GLn admit interesting (/-analogues. Giving A a partition of length at most n and 
fi E Z", the g-analogue of the Kostka coefhcient K\,fj_ giving the dimension of the weight space ^ in the 
irreducible finite dimensional GL„-module T/'^^" (A) of highest weight A is the Kostka- Foulkes polynomial 
K\^fj,{q) (also called Lusztig (/-analogue of weight multiplicity). Consider fi — (/i'-'^', /i'^''^) a r-tuple of 
partitions of lengths summing n and denote by fi the n-tuple obtained by reading the parts of the /i'-^^ 's from 
left to right. There exist in the literature different quantizations of the Littlewood-Richardson coefficient 
C^fi) giving the multiplicity of V^^"{X) in the tensor product V'^^" {fi'^^'>) (g) • • • (g) V'^^" {fi^'''>). 

In |5] Lascoux Leclerc and Thibon have introduced such a (/-analogue by mean of certain generalizations 
of semi-standard Young tableaux called ribbon tableaux. They have proved in ^HI that the polynomials 
obtained belong to a family of parabolic Kazhdan-Lusztig polynomials introduced by Deodhar which have 
nonnegative integer coefficients |0. 

When /j,*^'') are rectangular partitions, it is also possible to define (/-analogues of the coefficients 

c^(i) ^(,.) by considering the one-dimensional sums X® ^{q) obtained from affine ^i^'-crystals associated to 

Kirillov-Reshetikhin /7^(sZ„)-modules 

Consider r] — {7]^, .■■,rj^) a sequence of positive integers summing n and suppose that /i'-^^ has length 7/^ for 
any p — \, r. The Littlewood-Richardson coefficient c^(i) also coincide with the multiplicity of the 

tensor product I/'^^n (/i^^^) ® ■ ■ ■ ® I/*^^"--" (/i^'")) in the restriction of V^^"{X) to its Levi subgroup GL^ — 
GLrj^ X • ■ • X GLjf . This duality permits to express c'^(i) ^(r) in terms of a Kostant-type partition function. 
By quantifying this partition function, Shimozono and Weyman |18) have introduced another natural q- 
analogue of c^(i) ^^^-| that we will denote K^^"^' (q) {I being the set of the simple roots of GLr^. The 

polynomials K^^"'\q) are Poincare polynomials and appear in the Hilbcrt series of the Euler characteristic 
of certain graded virtual G- modules. By a result of Broer they admit nonnegative coefficients providing 
that the /i'^^'^'s are rectangular partitions of decreasing heights. In this case Shimozono has proved in ^H] 
that K^^"' ((/) coincide with Xf ^(q). This result which is based on a combinatorial description of the 
polynomials K^^"'^ {q), permits in particular to recover that they have nonnegative coefficients independently 
of the results of Broer. Under the same hypothesis, it is conjectured that Kf^"'^{q) also coincide with the 
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LLT quantization of c^^, ^(^^ . When the /i^^^'s are simply row partitions, we have /i = (m^^^ 1^^^^) G 
and K'^^"'\q) is the Kostka-Foulkes polynomial associated to the weights A and fi. 

Let G be one of the classical groups GLn, S02n+i, Sp2n or S02n and Rq its set of positive roots. Kostka and 
Littlewood-Richardson coefficients can be regarded as branching coefRcients corresponding to the restriction 
of GLn to its principal Levi subgroups. This naturally yields to study the branching coefficients corresponding 
to the restriction to a subgroup Gq (not necessarily of Levi type) of G and their corresponding g-analogues. 
The branching coefRcients which are considered in this paper can be expressed in terms of certain partition 
functions counting the number of way to decompose a weight of G into a linear positive combination of 
simple roots belonging to a Rxed subset of Rq. To obtain the corresponding g-analogues of these coefRcients, 
it sufRces to quantify these partitions functions. In particular when Go — Hq is the maximal torus of G, the 
g-analogues obtained in this way are precisely the Lusztig g-analogues of weight multiplicities associated to 
GM- 

Our aim in this paper is two fold. First, we study the natural quantizations of branching coefficients corre- 
sponding to the restrictions of G to the Levi subgroups of its standard parabolic subgroups. These polyno- 
mials will be denoted Kf'^{q) where / is the set of simple roots of the Levi subgroup Lc j considered. The 

polynomials K^'^{q) are generalizations of Lusztig g-analogues of weight multiplicities which coincide with 

the g-analogues 

^xt^'^il) for G = GL„. From the results of I , one can derive that they have nonnegative 
coefRcients when is stable under the action of the Weyl group of Lqj. The polynomials iir^^"'^(g) indexed 
by pairs of dominant weights A and /i which contain sufficiently large multiples of the fundamental weight 
K = (!,...,!) e N" are called stable. This terminology reflects the fact that they are invariant if A and 
fjL are translated by k. When the Levi subgroup Lqj is isomorphic to a direct product of linear groups, 
we prove that this stable limit decomposes as nonnegative integer combination of polynomials Kf^"^'^{q) 
(Theorem I3.2.4|l . This result can be regarded as a generalization of the decomposition of the stable limit 
of Lusztig g-analogues associated to G as a sum of Kostka-Foulkes polynomials given in ^Jj . For a general 
Levi subgroup, we conjecture that the polynomials K^'^(q) have nonnegative coefRcients providing that /i 
is a partition f Conjecture I3.1.4|l . Note that this condition is in particular fulfilled when /z is stable under 
the action of the Weyl group of Lqj. While writing this paper, the author was informed that an equivalent 
statement of this conjecture first appeared in some unpublished notes by Broer. 

Next we study Littlewood-Richardson- type coefRcients associated to G = S02n+i, Sp2n or S02n and dis- 
cuss the problem of their possible quantizations. Note first that the LLT quantization of the Littlewood- 
Richardson coefficients for GL„ is based on a very special property of the plethysm of the Schur functions 
with the power sums. Indeed the coefficients appearing in the decomposition of this plethysm on the basis 
of the Schur functions are, up to a sign, Littlewood-Richardson coefficients. An analogous property for the 
other classical groups does not exist. Thus it seems impossible to relate g-analogues of tensor product multi- 
plicities to Deodhar's polynomials by proceeding as in 10 . With the above notation for fi and 77, we define 
the coefficient ^(^, as the multiplicity of the finite dimensional irreducible G-module V^'^(A) of highest 

weight A in the tensor product V'^lp,^^'') • • ■ (g) T^'^(/^ ''"-'). We show that this coefficient can be expressed in 
terms of a partition function fProposition l4.l3)) . This implies in particular that it does not depend on G. We 
also establish a duality result (Proposition ^^31 between the coefRcients and certain branching 

coefRcients corresponding to the restriction of S02n to the subgroup S02rj^ x • • ■ x S02ri^ (which is not 
isomorphic to a Levi subgroup of S02n)- This permits to deflne g-analogues for the coefficients 'i^(i) ^(r) 
but the polynomials obtained in this way may have negative coefRcients even if the n-tuple /i is a partition. 
Denote by 2J'^(A) the restriction of the irreducible finite dimensional Gijv-modulc of highest weight A to G 
where 2n -f 1 if G = S02n+i and iV = 2n if G = Sp2n or 502„. By replacing each module V^^i'^p^) by 
^^ilj'-P^) in the definition of d^^,-, (^), one obtains tensor product coefRcients S)'*';^ which can also 

be expressed in terms of a partition function. Thus, they admit natural quantizations fj,{r)il)- Note 

that this time the coefRcients S^J^^ ^(r) and the polynomials 33^}^ ^(r) (?) depend on the lie group G con- 
sidered. We obtain a duahty between the g-analogues S'^J^ (g) and the stable hmit of the polynomials 
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K'^'^{q) associated to the Levi subgroup GL,j_^ x • • • x GL,f^. In particular the polynomials S^J^^ p(') (?) 
decomposes as nonnegative integer combination of polynomials K'^^"'\q) f Theorem I4.4.2|l and have non- 
negative integer coefficients when the /i'^^-''s are rectangular partitions of decreasing heights. Within each 
nonexceptional family of affine algebras, the one-dimensional sums have large rank limits which are called 
stable one-dimensional sums 16 . There exist four distinct kinds of stable one-dimensional sums X'^ labelled 
by the symbols <) = 0, (1), (2), (1, 1). The stable one-dimensional sums of kind are related to A^^}^^-aSine 
crystals whereas the stable one-dimensional sums of kind (1), (2), (1, 1) are defined from the other nonexcep- 
tional families of affine crystals. Then, according to Conjecture 5 of ^7] giving the decomposition of in 
terms of one-dimensional sums X®, the three families of g-analogues (q), G = S02n+i, Sp2n and 

S02n should coincide (up to a simple renormalization) respectively with the stable one-dimensional sums of 
kind (1), (1, 1) and (2) associated to fi when the ^^^^'s are rectangular partitions of decreasing heights. This 
means that it should be possible to extend the results of |E1 which holds when the ^'^^^'s are row partitions 
of decreasing heights to all stable one-dimcnsional sums by establishing Conjecture 5 of |17j . 

The paper is organized as follows. In Section 2 we review the necessary background on branching mul- 
tiplicity formulas and Levi-subgroups for classical Lie groups. In particular we introduce the Kostant-type 
partition functions which permit to compute the branching coefficients we use in the sequel. Section 3 is 
concerned with the g-analogues of branching coefficients corresponding to the restrictions to Levi subgroups. 
We prove that they admit a stable limit which decompose as nonnegative integer combination of Poincare 
polynomials when the Levi subgroup considered is isomorphic to a direct product of linear groups. In sec- 
tion 4, we use the Jacobi-Trudi type determinantal expressions for the Schur functions of classical type to 
derive a duality between the Littlewood-Richardson coefficients d^^^ ^(^) and the branching coefficients 
corresponding to the restriction of S02n to S02n-^ x • • • x S02rj^- This duahty and the arguments used to 
proved it generalize the results of (corresponding to the case when all the /i'^'^'s are row partitions). 
We observe that the natural quantization of the multiplicities rf^(i) ^(r) may have negative coefficients. 

We then introduce the polynomials ^(^j (q) and show how they are related to the g-analogues of the 

branching coefficients corresponding to the restriction of G to GLjf_^ x • • • x GLj^^. 



2 Background 

2.1 Branching multiplicity formulas 

In the sequel G is one of the complex Lie groups GLn, Sp2n, S02n+i or S02n and q its Lie algebra. We 
follow the convention of |H] to realize G as a subgroup of GLn and g as a subalgebra of gljy where 




n when G = GL„ 

2n when G = Sp2n 

2n + 1 when G = S02n+i 

2n when G = S02n 



With this convention the maximal torus Tq of G and the Cartan subalgebra \)c oi q coincide respectively 
with the subgroup and the subalgebra of diagonal matrices of G and q. Similarly the Borel subgroup Bq 
of G and the Borel subalgebra bo of g coincide respectively with the subgroup and subalgebra of upper 
triangular matrices of G and g. 

Let djv be the linear subspace of gljy consisting of the diagonal matrices. For any i £ {1, n}, write Si for 
the linear map Si : ~* C such that £i{D) = Si for any diagonal matrix D whose (i, i) -coefficient is Si. 
Then (ei, ...,£„) is an orthonormal basis of the Euclidean space f)g. ^ (the real part of Let Rq be the 
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root system associated to G. We ean take for the simple roots of q 

^GL(n) ^ ^' ^ * ^ n-lioY the root system A„_i} 

^ = {«„ = £„ and tti = Ei - £i+i, i = 1, ...,n - 1 for the root system B„} ^.^^^ 

^Sp2,i ^ 'i'^" ^ ^'^^ tti = Ei — Ej+i: i = 1, n — 1 for the root system C„} 
, S^Q^^ — {an — En + £n-i and ai — Si — £i+i, « = 1, 7i — 1 for the root system 

Then the set of positive roots are 

-^GL ~ i^i ~ + ■^ith 1 < I < j < n} for the root system A„_i 

Rs02 1 — {^i ~ + with l<i<j<n}[J {e,; with 1 < i < n} for the root system i3„ 
Rgp^ = {si — Ej, £i + £j with 1 < i < j < n} U {2£i with 1 < i < n} for the root system C„ 
^S02 ~ 'L^* ~ ^J ' ~'~ with 1 < i < i < 77-} for the root system Z?„ 

We denote by Rq the set of roots of G. The Weyl group of GL„ is the symmetric group Sn and for 
G = S02n+i, Sp2n 01 SO^m the Weyl group Wg of the Lie group G is the subgroup of the permutation 
group of the set {n, 2, 1, 1, 2, n} generated by the permutations 

r Si = + « + 1), i = 1, n — 1 and s„ = (n,ri) for the root systems Bn and C„ 

[ Si = (i, i + !)(«, i + 1), i = 1, 71 — 1 and sj^ = {n, 7i — l)(7i — 1, n) for the root system D„ 

where for a ^ b (a, b) is the simple transposition which switches a and b. For G = S02n+i, Sp2n or S02n, we 
identify the subgroup of Wg generated by Si = (i,i + l)(z,z + l), i — l,...,7i — 1 with the symmetric group 
Sn- We denote by ^ the length function corresponding to the above set of generators. The action of w G Wg 
on P= (/?!, ...,/?„) G t)^_R is defined by 

w{^,,...,^n) = Wr,-,^n) 

where = if cr(i) G {l,...,n} and /3™ = — otherwise. We denote by the half sum of the 

positive roots of R^. The dot action of Wg on /? = {f3i, ...,/?„) G f)^ is defined by 

wof3^w{f3 + pG)-PG- (2) 

Write P+ for the cone of dominant weights of G. Denote by Vn the set of partitions with at most n parts. 
Each partition A = (Ai,...,A„) G Vn will be identified with the dominant weight '^^^i^i^i- Then the 
irreducible finite dimensional representations of G are parametrized by the partitions of Vn- For any A G Vn, 
denote by V'-^{X) the irreducible finite dimensional representation of G of highest weight A. In the sequel we 
will also need the irreducible rational representations of GLn- They are indexed by the n-tuples 

(7+,7") = (7^7j,-,7^0,...,0,-7g",...,-7r) (3) 

where 7"'' and 7" are partitions of length p and q such that p+q < n. Write Vn for the set of such n-tuples and 
denote also by V'~^^" (7) the irreducible rational representation of GLn of highest weight 7 — (7^, 7^) G Vn- 
Consider a r-tuple 77 — {rji, ...,7]^) of positive integers summing n. Given /x = (/i^^^ /i'^''^) a r-tuple of 
partitions such that /i^^-* G Vrj^ for p — 1, ...,r, we denote by /i the ri-tuple obtained by reading successively 
the parts of the partitions /i*-^-*, /i^''-' from left to right. 

As customary, we identify Pa the lattice of weights of G with a sublattice of (^Z)". For any /3 = {P^, - f3n) ^ 

Pg J we set \(3\ = /S^H [-/3„. We use for a basis of the group algebra Z[Z"], the formal exponentials (e^)^gz" 

satisfying the relations e^'^e^'^ — e^^^^"^. We furthermore introduce n independent indeterminates xi, a;„ in 
order to identify 'L\IP'\ with the ring of polynomials Z[a;i, a;„, a;j~^, by writing = x^^^ • --Xn" — x^ 
for any /3 =(/?!,.. .,/3JgZ". 

For any A G P„, we denote by the universal character of type G associated to A and by T'^ the ring of 
the universal characters of type G defined by Koike and Terada [HI ■ 

We now give a technical lemma that we will be led to use in the sequel. Consider A G , /i G Z" and G one 
of the Lie groups S02n+iTSp2n or S02n- Set n = (1, 1) G N". 
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Lemma 2.1.1 Let : Z" ^ 'E[q] be a map such that for any (3 G Z", M.{f3) = if \P\ < 0. Then for any 
integer k > ^'^^'^^^ we have: 

^ (-l)^(-)A^(u;(A + kK + pa)-ti- kK -Pg)^Y. {-^Y^"^M{a{\ + p)-p-p) (4) 
w^Wg o-es„ 

where p — {n,n — I, 1). 

Proof. Consider S = {6i, ...,6n) e and w e Wg- Write w{S) = ((5^", ...,(5;^') and set ^ {i \ w^i) ^ 
{l,...,n}}. Define the sum — J2ieE^^ik- Then|w(5)| = 2 5. Now consider fc a nonnegative integer 

and set S = {X + p^ + kn). We have |w(A + Pc + kK)\ = |(A + + kK)\ ~ 2Sw,s- But Sw,s = S'^.A+p^ + kp 
where p = card(i?tu). Thus we obtain 

+ Pg + kn) - {tJ- + Pg + ki^)\ = \{X + Pg + kK)\ - 2S'„,,a+pg ~ I(a* + Pg + kK)\ - 2kp = 

|A| - \p\ - 25^,A+p^ - 2kp. 

When w ^ S„, we have p > I and Suj^A+pg > 1 since the coordinates of A + are all positive. Hence 
|u'(A + Pg + ktt) — (p + Pg ~^ ^Kjl < |A| — \p\ — 2k and is negative as soon as fc > -i^Lkii, Yot such an integer 
k the sum defining the left hand side of the equality Q normally running over Wg can be restricted to 5„ . 
Moreover we can write Pq = p + ek with e = — i, or 1 respectively for G = 502„+i, Sp2n or S02n- Since 
(j{pk) — pn for any p G (^Z)", this yields to the desired equality. ■ 

Let Go C G be a complex Lie subgroup of G and Qq its Lie algebra. We suppose in the sequel that Go is 
isomorphic to a product of classical Lie groups whose maximal torus To is equal to Tg- Let t)o be the Cartan 
subalgebra of go. We have [)o — i)G, thus f)o — f)^. In particular we can consider the set i?o of roots of go 
and its subset of positive roots Rq respectively as subsets of Rg and Rq . 
The partition function Vgo associated to Gq is defined by the formal identity 

n = E (5) 

Note that Vgo coincide with the Kostant partition function when Go — Tg (that is R^ = 0). Write P^.^ 
for the cone of dominant weights of Go- For any A in Pq and /j, in Pq^ we denote by [V{X)'^ : V{fj,)'^°] 
the multiplicity of the irreducible Go-module V{fi)^" of highest weight fi in the restriction of the G-module 
V{X)^ to Go. 

Theorem 2.1.2 With the above notation we have 

[V{Xf -.Vifif"]^ ^ {-lY^^^V^"iwoX- fj,). 

w£Wa 

We refer the reader to Theorem 8.2.1 of 4 for the proof 

2.2 Branching coefficients associated to Levi subgroups 

Consider / a subset of Eg the set of simple roots associated to the classical Lie algebra G. Denote by ttgj 
the standard parabolic subgroup of G (that is containing the Borel subgroup Bg) defined by /. Recall that 
the roots of ttgj are those of Rq together with the negative roots of Rg which are Z-linear combinations 
of the simple roots contained in /. Write Lg.i for the Levi subgroup of the parabolic ttgj and Igj its 
corresponding Lie algebra. Let Rgj be the subsystem of roots spanned by / and Rq j the subset of positive 
roots in Rgj- Then Rgj and Rq j are respectively the set of roots and the set of positive roots of Igj- 
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The Levi subgroup Lqj corresponds to the removal, in the Dynkin diagram of G, of the nodes which are 
not associated to a simple root belonging to /. Write 

J = S+ - / = {ttji, ...,ajj 

where for any fc = 1, r, aj^, is a simple root of and ji < • • • < jr- Set h = ji, Ik = jk — jk-i, k — 2, r 
and Ir+i = n — jr- According to |7], the Levi group Lqj is isomorphic to a direct product of classical Lie 
groups determined by the (r + l)-tuple Ij = {h, ...,lr+i) of nonnegative integers summing n. We give in the 
table below the direct product associated to each Levi group Lqj. 



1 


G = 








Lgj 


^GLi, 


X • 


■ X GLi^_ 


n 




2 


G = 


S02n+i and Z^+i > 2 






Lqj 


^GLi, 


X • 


■ X GLi^ 


X 


'5'02;^_i_i+l 


3 


G = 


S'p2n and /,.+! > 2 






Lgj 


^GLi, 


X • 


■ X GLi^ 


X 




4 


G = 


<5'02n and Z^+i > 4 






Lgj 


^GLi, 


X • 


■ X GLi^ 


X 


S02l^+i 


5 


G = 


S'02n+l,5'p2n Or S'02n 


and Ir+i 


= 


Lgj 


^GLi, 


X • 


■ X GLi^ 




6 


G = 


S02n+l,Sp2n Or S'02n 


and Ir+i 


= 1 


Lgj 


^GLi, 


X • 


■ X Gi/,_ 


X 


SL2 


7 


G = 


<5'02ri and Z^+i — 2 






Lgj 


:^GLi, 


X • 


• X GLi„ 


X 


SL2 X SL2 


8 


G- 


S02n and Zr+i = 3 






Lgj 


:^GLi, 


X • 


■ X GLi„ 


X 





(6) 



Note that Ir+i — p means that aj^ — an-p. The factors of the decomposition of Lgj in a direct product 
of classical groups are giving by the connected components of the diagram obtained by removing the nodes 
corresponding to the simple roots aj-^ , aj^ in the Dynkin diagram of the root system of q. 
Since the Levi group Lgj is isomorphic to a direct product of classical groups and contains the maximal 
torus Tg, we can define the partition function Vj associated to Go = Lqj as in H2.1|l by the formal identity 

where Sgj = Rq — Rq /• Note that Sgj does not coincide in general with the subset of positive roots of 
obtained as N-linear combinations of the simple roots a^j, ...,aj^. We describe in the table below, the 
sets Sg.i corresponding to the decompositions of Lqj given in ©. Set 

f {e. + £j I 1 < ^ < J < n} U {e, I 1 < « < n} if G = 502n+i 
Og = < {Si + ej I 1 < i < j < n} if G = Sp2n+i and 
[ {e^ + £j I 1 < ^ < J < n} if G = 5'02„ 

r Gg - {£„} if G = 502„+i 
- <^ Gg - {2£„} if G = 5p2„+i 

[ Qg - {£n-l + £n} if G = S'02n 



1 


Sgj = U 

s=l 






1 < 


i < is 


<i 


< 


n} 








2 


Sgj = U 

s=l 






1 < 


i < is 


<i 


< 


n} U {£, ^ 




^ l£ i < i l£ n and i 


<ir}U {£, 


3 


Sgj = U 

s=l 






1 < 


i < is 


<i 


< 


n} U {e^ ^ 




^ l£ i l£ 3 1^ n and i 


<ir} 


4 


Sgj = U 

s=l 




-£3 


1 < 


i < is 


<i 


< 


n} U {e^ ^ 




^ l£ i < i 1^ n and i 


<ir} 


5 


Sgj = U 

s=l 


{£. 


-£3 


1 < 


i < is 


<i 


< 


n} U Gg 








6 


Sgj = U 

s=l 


{£. 


-£3 


1 < 


i < is 


<i 


< 










7 


Sgj = U 


{e^ 


-£3 


1 < 


i < is 


<i 


< 


n}ue*a 








8 


Sgj = U 


{£. 


-£3 


1 < 


i < is 


<i 


< 


n} U {e, ^ 




^ l£ i < i 1^ n and i 


< n - 3} 
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Example 2.2.1 Consider G = Sps- We give below the 16 possible sets I and Sg,i for each Levi subgroup 



I 


Lgj 


Sgj 


{ai, q;2, as, 014} 


Sps 





{a2, as, 04} 


GLi X Spe 


El ±£2,ei ±£3,^1 ±£s,2£l 




G TyO X Sr)A 


£1 ± £s, £1 ± £4, £2 ± £s, £2 ± £4 
£1 + £2, 2£i, 2£2 


\ rvQ Cm A \ 




£1 ± £2, £1 ± £3, £1 ± £4, £2 ± £3, £2 ± £4 
2£l,2£2 




(7L^ X .S'Lt 

\j ±j ^ /\ ±j 2. 


£1 + £2, £1 + £3, £1 ± £4, £2 + £3, £2 ± £4 

£S ±£4,2£i,2£2,2£3 


\ f\^ f\ a\ 


GL-y X (7Li X .SLo 


£1 + £2, £1 ± £3, £1 ± £4, £2 ± £3, £2 ± £4 
£3 ± £4, 2£i, 2£2, 2£3 




GT,^ X G/^,n X Sr.T 


£1 ± £2, £1 ± £3, £1 ± £4, £2 + £3, £2 ± £4 
£3 ± £4, 2£i, 2£2, 2£3 




X (7Li X (7Li x .S'Lo 


£1 ± £2, £1 ± £3, £1 ± £4, £2 ± £3, £2 ± £4 
£S ± £4, 2£i, 2£2, 2£3 


rvn rvo > 


GLi 


£1 + £2; £1 + £3, £1 + £4, £2 + £3j £2 + £4 
£3 + £4, 2£i, 2£2, 2£3, 2£4 




GLi X 


£1 ± £2, £1 ± £3, £1 ± £4, £2 + £3, £2 + £4 
£3 + £4, 2£i, 2£2, 2£3, 2£4 




(7Lq X (7Li 

v_J J—/ . j /X \_j J_J 


£1 + £2, £1 + £3, £1 ± £4, £2 + £37 £2 ± £4 
£3 ± £4, 2£i, 2£2, 2£3, 2£4 


{ai, as} 


GL2 X Gi2 


£1 + £2, £1 ± £3, £1 ± £4, £2 ± £3, £2 ± £4 
£3 + £4, 2£i, 2£2, 2£3, 2£4 


{"3} 


Gil X Gil X Gi2 


£1 ± £2, £1 ± £3, £1 ± £4, £2 ± £3, £2 ± £4 
£3 + £4, 2£i, 2£2, 2£3, 2£4 


{"2} 


Gil X Gia X Gil 


£1 ± £2, £1 ± £3, £1 ± £4, £2 + £3, £2 ± £4 
£3 ± £4, 2£i, 2£2, 2£3, 2£4 


{«i} 


Gi2 X Gil X Gil 


£1 + £2; £1 i £3; £1 i £4, £2 i £3? £2 i £4 
£3 ± £4, 2£i, 2£2, 2£3, 2£4 





Gil X Gil X Gil X Gil 


£1 ± £2, £1 ± £3, £1 ± £4, £2 ± £3, £2 ± £4 
£3 ± £4, 2£i, 2£2, 2£3, 2£4 



Note that Gil x GL2 x S'i2 ~ Gii x Gis and Gii x Gii x Gii x SL2 ~ Gii x Gii x Gia. 

Suppose that the Levi subgroup Lgj decomposes following (jHl in 

Lgj ^GiX---xGp (7) 

where the G^'s are classical Lie groups. Write Pq j for the cone of dominant weights of Lgj- The dominant 

weights of J can be regarded as sequences fj, = (/^^^^ ...,^'^^) such that /Lt^**) belongs to Vi if Gg = GLi 

and fi^P^ belongs to Vi if Gp = SLi, SO21+1, Sp2i or 502i- Recall that, for such a dominant weight — 
{jl'^^\ fi^'P^), we denote by ^ G Z" the sequence obtained by reading successively the parts of 
from left to right. 

We deduce immediately from Theorem 12 . 1 . 21 the branching coefficients for the restriction of ^"^(A) to the 
Levi subgroup Lq j. 

Theorem 2.2.2 Consider X £ Vn and fi E Pg i i^^-n 

■w£Wg 
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Note that Lc.i — GLn when / — {ai, ...,q;„_i}. In this case, the branching coefRcients [V{X)'~^ : ^(7)'^^"] 
where 7 G Pn can be expressed in terms of the Littlewood-Richardson coefficients cjj^ ^ . For each classical 
group S02n+i, Sp2n and S02n, set 

n (i-o-'= E (8) 

aeec ,3gN" 

Denote by Vn"^ and Vn'^^ the sub-sets of T'n containing respectively the partitions with even rows and the 
partitions with even columns. 

Proposition 2.2.3 Consider v EVn and A = (A^. A^) G T';. Then 

1. [VivfO.-^^ : V{\r^-] = E.,eH',„ (-l)''"V5o.„+. {w o u - (\+ , A")) = c!;^,^, , 

2. [V{vfP^- : y(A)«^"] = E.ewe„ (-l)'^'"^^Sp.„(^^ o ^ - (A+, A")) = E,,,,p(=) c^.c^.^,- , 

5. : V{Xf^-] = E.eVK.„(-l)'^"'^^50.„(i«oi.- (A+, A-)) = E^,,eP<^'^' ^7.^4+,a-- 

Proof. The right equalities of the Proposition are obtained by Theorem 12.2.21 The left follow from a 
classical result by Littlewood (see ^S] appendix p 295). ■ 

Remark: When A is a partition (that is A"*" = A and A^ = 0) we have by the above proposition 



[V{vYP-- : F(A)«^"] ^ E,7vi'^"c';l' . (9) 
[l^(^)^o-:F(A)G^"]=E^J<M)c!;,, 

In particular for k=(1,...,1)g N" and any nonnegative integer k we obtain 

[V{u + knf : V{X + knf^-] = [V(vf : V{Xf^"]. 

2.3 Branching coefRcients associated to an orthogonal decomposition of the 
root system D„ 

Consider a r-tuple 77 = {r]^, ■■■,1]^) of positive integers summing n. We associate to 77 the orthogonal decom- 
position Dfj = Drf^ U • • ■ U Dri^ of the root system _D„ such that for any fc = 1, r 

= {±£» ± I '^fc-i + 1 < i < j < r/J 
with 77q = 1. Then S02n contains a subgroup SOjj such that 

Note that 50,, is not a Levi subgroup of S02n- The dominant weights of 5*0,, are the r-tuple of partitions 
/i. = (/x*-^\ /i'-'^-') such that /j,*^'^^ belongs to Vri,, for any fc = 1, r. Since S'O,, contains the maximal torus 
of S02n we can apply Theorem 12 . 1 . 21 with Go = SOr/. The corresponding partition function is defined by 
the formal identity 

where = U2<p<r{(«, j) | 1 < « < J?! H ^ '/p-i < J < '^}■ 

Proposition 2.3.1 Consider A a partition and fi a dominant weight of SOn- Then 

[-^(A)SO.„ . y(^)SO„j ^ ^ (-l)^('")7'''(w o A - Ai). 

Remark: Although it is possible to obtain similar branching coefficients starting from orthogonal decom- 
positions of the root systems Bn and C„, we do not use them in the sequel. 
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3 Generalization of Lusztig g-analogues 



3.1 Quantization of the partition functions associated to a Levi subgroup 

Consider a classical group G and / a subset of S^. We associated to the Levi subgroup Lqj the q-partition 
function V^'^ defined from the formal identity 

n = E (11) 

Definition 3.1.1 Let A he partition ofVn and fi a weight of Lqj. We denote by K^'^{q) the polynomial 

^xfM = E ° A - A*). (12) 

Remark: Since V^^\(3) = for any /3 e Z" with |/3| < 0, we have -ftT^^f (g) ^ only if |A| > |^| . 

When /i. is a dominant weight of Lqj, we deduce from Theorem 12.2.21 that the polynomial K'^'^{q) is a 
q-analogue of the branching coefficient [^(A)'^ : V{fi)-'^'^'']. When 1 — 9, that is when Sg,i contains all the 
simple roots of G, Lqj coincide with the maximal torus of G, thus Pq j — Pq and K^'^{q) is the Lusztig 
q-analogue associated to the weight /i in V{X)^. If we suppose that /i is a partition, it is known [2| that 
K^'^(q) has nonnegative integer coefficients. 

The polynomials K^'^{q) can also be defined from the Hilbert series of the Euler characteristic associated 
to certain graded virtual G- modules . When fi is a. dominant weight stable under the action of the Weyl 
group of Lgj, Broer has proved in Theorem 2.2 of [P that the higher cohomology vanishes in the Euler 
characteristic associated to X/j,- In this case, by the use of the Borel-Weil-Bott Theorem, its graded formal 
character has a nonnegative expansion on {e^ | A £ Vn}- This implies in particular that K^'^(q) has 
nonnegative coefficients. Note that the results of ^ does not require that G is a classical Lie group. In the 
context of this article, the dominant weight /x = is stable under the action of the Weyl group 

of Lgj if and only if the /x^'^'^'s are rectangular partitions of decreasing heights and /x'''-' = when Lg,i is 
not a direct product of linear groups. This yields to the following theorem: 

Theorem 3.1.2 (from fl^) Consider Lgj a Levi subgroup of the classical lie group G. Let \ be a partition 
of Vn and fj, = (/x^^-*, /i'-''-*) a dominant weight of Lgj such that the /x*-'^-' 's are rectangular partitions 
of decreasing heights with ^^^'^ — when Lq.i is not a direct product of linear groups. Then K^'^{q) has 
nonnegative coefficients. 

When G = GLn, the polynomial K'^^"'^ (q) can also be interpreted as a q-analogue of the generalized 
Littlewood-Richardson coefficient c^(i) ^^j,., giving the multiplicity of F(A)*^^" in l/'^^" (/x^^^) • ■ • (g) 
^GL„^^(r)^_ Suppose that the /i'^'^^'s are rectangular partitions and denote by Xf ^{q) the one-dimensional 

sum defined from the affine -crystal Bfj, associated to fx and the partition A (0). In fact ^{q) is 
defined up to a power of q depending on the normalization of the energy function iJ^ chosen on the vertices of 
B^. By using a Morris- type recurrence formula for the Poincare polynomials and a combinatorial description 
of the polynomials K^^"'\q), Shimozono has obtained the following theorem: 

Theorem 3.1.3 \L5f Let X be a partition ofVn and fj, ~ 1^^^^) a dominant weight of Lgj such that 

the ii^'^^ 's are rectangular partitions of decreasing heights. Then 

K^!;-'\q)^q*Xl^{q) 

where q* is a power of q depending on the normalization chosen for . 
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Remarks: 

(i) : Thcorcm lH . 1 . HI gives in particular a combinatorial proof of the positivity of the polynomials K^^"'^ (q). In 
the next paragraph we will use this result to derive the positivity of the stable limits K'^'^{q) independently 
of Theorem 13X3 

(ii) : Under the hypotheses of Theorem 13 . 1 . 3l it is conjectured that the polynomials K"^^"'^ (q) coincide with 
the g-analogues of the Littlewood- Richardson coefficients introduced by Lascoux Leclerc and Thibon jlO| . 

Numerous computations lead to conjecture that the positivity result of Theorem 13 . 1 . 21 can be extended to 
the case when the r-tuple /i associated to the dominant weight /x G Pq j is a partition. 

Conjecture 3.1.4 Let A be partition of Vn and fi a dominant weight of Lqj such that fi is a partition. 
Then K^ ilil) ^'^^ nonnegative coefficients. 

I was informed that an equivalent statement of this conjecture appeared for the first time in unpublished 
notes by Broer. In the terminology of 1 , it is indeed equivalent to say that higher cohomology vanishes in 
Xfj, when /i is a dominant weight. 

Example 3.1.5 Continuing Examvle \2.2.1\ with G = Sp^, A = (4, 2, 2, 1) and /i = (3, 1, 1, 0), we obtain the 
following polynomials Kf'^{q) 







Sps 





GLi X Sp6 





GL2 X Spi 




GLi X GLi X Spi 


q^ + 2g2 


GL3 X SL2 


^3 ^ ^2 


GL2 X GLi X SL2 


Sg'^ + Aq^ + q^ 


GLi X GL2 X SL2 


q^ + 2q^ + q^ 


GLi X GLi X GLi x SL2 


2q^ + Aq^ + Aq^ + q^ 


GLi 




GLi X GL3 


q^ + q^ 


GL3 X GLi 


q^ + 2q^ + q^ 


GL2 X GL2 


■^q^ + 4g3 + g2 


GLi X GLi X GL2 


2q^ + 4(7'' + Aq^ + q^ 


GLi X GL2 X GLi 


q^ + 2q4 + 3q2 + q^ 


GL2 X Gil X GLi 


q^ + 2(j6 + 3(j5 + Aq" + 4g3 + 


GLi X Gil X Gil X Gil 


q^ + 2g^ + 3(7^ + 4(7^ + Sq'' + 4g3 + q^ 



When Lg,i — GLi x Gii x Gii x Gii, K'^'^{q) is the Lusztig q-analogue for the root system C4 associated 
to the partitions A and fi. Note also that the polynomials corresponding to the isomorphic Levi subgroups 
Gil X Gi2 X SL2 — Gil X Gia and Gii x Gii x Gii x SL2 — Gii x Gii x Gi2 are equal. 



In the sequel we will also led to consider another family of g-analogues for the branching coefficients 
[y(A)'^*^^"+i : V{p)^'^^^'^+^] obtained from the partition function V^'f^^"^^'^ defined by the expansion 

where h(a) = 2 if a = e^, i = 1, ...,n and h{a) ~ 1 otherwise. 
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Definition 3.1.6 Let A be partition ofVn and /x a dominant weight of Lso2n+i,i- denote by A^f*^^"^^'^('?) 
the polynomial 

We have clearly A^f*^^"^^'^(l) = iff ^^"^^'^(1). Note that the polynomials A^f ^^"^^'^(9) can have negative 
coefficients even if the hypotheses of Conjecture 13. 1.41 are verified. Nevertheless we are going to see that they 
admit a stable limit which decompose as nonnegative combination of Poincare polynomials. This is not the 
case for the polynomials iff ^^"^^'^(g) which implies that they can not coincide with one-dimensional sums 
(see Coni ecture 14 .4 . 3|) . This situation is analogous to that observed in where the one-dimensional sums 
considered are, for affine crystals of kind (1), equal to Lusztig q-analogues related to affine Hecke algebras 
of type Bn with parameters q and g^. 

3.2 Stable limit 

With the notation of the above paragraph, we define the stable limit K'^'^{q) by setting 
f>Gjf , i E.e5„(-l)'*"^^f o A - /i) if G = Gi„, Sp,n or SO^n 



i:.e5„(-l)'<"^n':^"'^"'(^ O A - /i) if G = 502n+l 



This is an expression for G a classical Lie group, but the sum runs over the parabolic subgroup of Wq 
generated by the s^, i ~ l,...,rt which is a copy of the Weyl group of the root system A„_i. We have 
Kx^"'^ il) ~ ^x^"'' il) since the Weyl group of GLn is the symmetric group Sn. 

Lemma 3.2.1 Consider A,/i two partitions of length n such that |A| > \fi\ . Let k be any integer such that 
k > -L^J^-L^. Then we have 

K^^'(a) = / ^A+L./x+feKl*?) when G = GL,,, Sp2n or S02n 
^ ' \ 5:r;i« (9) when G = S02n+i 

where k = (1, 1) £ N". 

Proof. Suppose G — GLn,Sp2n or S02n- For any (i G 17^, we have V^'^iP) = if /3 is not a hnear 
combination of the positive roots of Sg,i with nonnegative coefficients. This implies that V^'^iP) = if 
\/3\ < 0. Then the Lemma is a consequence of Lemma f2 . 1 . II applied with A4 = V^'^ . We proceed similarly 
for G = S02n+i by using V'i^^^ instead of 7',^^'"+''^ ■ 

Remark: Since (t(k) ~ k for any a G Sn, we have the following stability property 

^f+k^^^+kM = K^iil) for any integer k 

which justifies the above terminology. So we can extend the definition of K^'^{q) when A and /i are decreasing 
sequences of integers (positive or not). 

For any E Z" , we define the polynomial K^^"'^ {q) by replacing, in 1)12(1 the partition A by ^. There exists 

a straightening procedure for the polynomials K^j^"^'^ (q) which follows immediately from the fact that the 
set {(J o ^ I cr G Sn} (see (0) intersects at most one time the cone of dominant weights of GL„. 

Lemma 3.2.2 Consider ji and ^ in Z". Then 

Kf,^"''i<l) = (-l)'*"'^^:^"''!?) «/e = T o (i.) with T e Sn and v G Vn 
otherwise 

where P„ = {7 = (7^^, ...,7„) g Z",7i > 72 > ■ ■ ■ > 7n}- 



11 



In the sequel of this paragraph we restrict ourselves to the case when G = S02n+i, Sp2n or S02n and 
Ir+i = (with the notation of paragraph 12. 2(1 . This corresponds to the decomposition 5 given in table 
that is we suppose that / does not contains the simple root a„. In this case 

Lgj ^ Gi/i X • • • X GLi^. 

and / is also a subset of thus determinates a Levi subgroup of GLn which is isomorphic to Lgj- 

Moreover we have Sgj = Sgl„,i U ©g- The g-partition functions P^'^ , G — Sp2n or S02n and "P^^^"^^'^ 
can be expressed in terms of the g-partition "P^^"'^: 

Lemma 3.2.3 For any /? G we have 

f (i) : r^''if3) = Esew^lSHPl ^G^Pf ^"'^(/S - S) for G = Sp2n or S02n 

\ (ii) : P,T"""'(/5) =9l'=*'^'E.eN"j^|H/3rso.„,.(<5)Pf^-^(/3-<5) 

Proof, (i) : The g-partition function p^L„,i (jggjied by 
and since Sgj = Sql^J U ©g the g-partition function P^'^ verifies 
and we derive from JHJ 

n (1-96")-!= E gl*l/2rG(<5)e« (14) 

since the number of roots appearing in a decomposition oi 6 G N" as a sum of positive roots Sr + Sg with 
1 < r < s < n or 2ei with 1 < i < n is always equal to /2. Thus we obtain 

E T'^'if^y = E E 9'^'/'^,^"-^(7)rG(-5)e^+-. 

We derive the equality Pq'^{P) = ^j^s=/3''"G{S)<l^^^^'^P!f^"'^il)- Since the set Sgl„j contains only positive 
roots a with \a\ = 0, we will have P^^^'^ij) = when I7I ^ 0. So we can suppose I7I = and \6\ = in 
the previous sum. 

(ii) : Since h{a) = 2 when |a| = 1 we can also write 

n (l-g''(")e")"^= E9'"^W+.We«. 

Then we derive (ii) by proceeding as in (i) . ■ 

So I 

Remark: A similar result for the g-partition function Pq does not exit. Indeed the number of roots 

appearing in a decomposition of (5 e N" as a sum of positive roots Er + £« with 1 < r < s < n and Si with 
1 < i < n does not depend only of \5\ since je^ + £s\ 7^ |£i| • 

Theorem 3.2.4 Suppose G — S02n+i,Sp2n or S02n o,nd Ir+i — and consider A,/i £ Pn such that 
l-^l ^ ImI • Then for any integer k > .J^^ we have: 
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Proof. We only give the proof for G = Sp2n or 502n, the case G = S02n+i is similar. We have 

^x.i(i) = E + p) - (m + p))- 

Hence from the previous lemma we derive 

CTe5„ (5eN",|(5| = |/3 

where (3 — (t(A + p) — (/i + p) in the second sum. Since = |A| — , we obtain 

CTe5„ i5eN",|i5| = |A|-|^| 

For any a e 5„, we have cr-i(N") N" and rG(<5) = rG(cr((5)) since (7(60) = Og- Thus 

o-eS„ (56N'M5| = |A|-|^| 

9^ E ^GWi^S:;;(<z). (15) 

5eN",|i5| = |A|-|^ 

Now by Lemma frt.2.21 Kx-S flil) ^ ^ '^^ there exits ct G 5„ and 7 e Vn such that 7 = cr^^ o (A — (5). Then 
we have I7I = |A| — \S\ = and 5 = X + p — (7(7 + p). It follows that 

Kf,ii<i)-<i'^j:i-^y'^' E rG(A+p-a(7+p))if,^^^(g). 

Since c(5) = c((t((5)) for any cr G Sn and 5 G N", we obtain the equality 

KrM-<l'^ E E(-l)'^^'-G(a(A + p)-(7 + p))X,«^-^(<z). 

We deduce from Lemma [2.1.11 applied with M ~ tq and from Proposition 12 . 2 .31 that the equality 

(-l)'^"VG(a(A + p) - (7 + P)) = [^^(A + knf : ^(7 + knf^-] 

o-G5„ 

holds for any integer k > ^^^^^''^ = This yields to the desired equality. ■ 

By using Theorem 13. 1 . 31 wc obtain immediately 

Corollary 3.2.5 Suppose G = S02n+i, Sp2n or S02n and Ir+i = 0. Consider X G Vn, fJ' = (p(^\ M^^^) € 
Pg/ swc/i i/iai t/ie /i^*^^ 's are rectangular partitions of decreasing heights. Then Kx liil) have nonnegative 
coefficients. 

Remark: When G = Sp2n or S02n, Lemma [3.2.11 implies that the above corollary can be regarded as a 
particular case of Theorem 13.1.21 Since the polynomials -f^f ^^"^^'^(9) are generalized Lusztig g-analogues 
defined by using the parameters q and g^, we can not deduce their positivity from the results of Broer. 
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4 Some dualities between tensor product and branching coeffi- 
cients 



4.1 Determinantal identities and operators on formal series 

Consider fc,TO G Z such that m > 0. When fc is a nonnegative integer, write (fc)„ = (fc,0, ...,0) for the 
partition of length n with a unique non-zero part equal to k. Then set = if fc > and h'^ = 

otherwise where sJ^n is the universal character of Koike and Tcrada associated to (fc)„ for the Lie group G. 



Given a — (ai, , 



det 



G Z" define 



"-at 



/jG -I- TjG 



G 



"•Q„-m+2 



(16) 



"•Q„-2m+2 / 



The following proposition is a well known analogue of the Jacobi-Trudi determinantal formula for G = 

S02n+l, Sp2n Or S02n- 

Proposition 4.1.1 (see ^24-2) Consider A a partition with at most m nonzero parts. Then for G 
S02n+i, Sp2n or S02n we have uf 



By using elementary permutations on rows in the determinant (|16|) we obtain the straightening law for u^: 
Lemma 4.1.2 Consider a G Z™ then 

G _ j {—lY'^'^^s^ if there exists a G Sm and A G Vm such that a o a = X 
otherwise 



Denote by £„ — K[[xi, x^^ , ...,Xn,x~^]] the vector space of formal Laurent series in the indeterminates 
xi,Xi^, ...,Xn,x~^. We identify the ring of Laurent polynomials L„ = 'K[xi,Xi'^ , ...,Xn,x~^] with the sub- 
space of Cn containing the finite formal series. The vector space £„ is not a ring since the formal series are 
in the two directions. More precisely, the product i^i • • • of the formal series Fi = J^p.&E- ■^''^ * = 1j 
is defined if and only if, for any 7 G Z", the number of decompositions j = Pi + ■ ■ ■ + P^. such that P^^e- 
is finite and in this case we have 

7eZ" 



In particular the product P ■ F with P G L„ and P G is well defined. 

Consider a G Z™. We set h'^ = h'^^ ■ ■ ■ h'^^. Let K = [fci,...,/cm] C {l,...,n} be the interval containing the 
m consecutive integers fci < • • • < km ■ Denote by Ck C Cn the vector space of formal Laurent formal series 



in the indeterminates Xk^ , 



^ . We define the determinant 



Sk{c() = det 



Ql — 1 



^"2-1-1 
^fe2 



Qjji — m+1 ^Qti — 'm+2 I ^am—'>TT' 



Q2+m — 2 



„Qm-2m+2 



Set 



3 if 



n a-?^) n (1 



l<'i<j<m 



^ l<r<s<m 



Xk^Xk, 
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Then Sxio:) and 6k belong to £-k- From a simple computation we derive the equality: 

Sxia) = Sk ■x'^l ■ ■ ■ x'^^. (17) 

Consider rj = (rji, 77^) a r-tuple of positive integers summing n. We define from 77 the intervals Ki, 

of {1, by setting Ki = [1, ...,771] and for any p = 2, ...,r, = [77^ + ■ ■ • + 77p_i + 1, ...,771 H h 77,,]. 

Write (5,, = 5ki ■ ■ ■ Sr,- ■ 
Set 

n (i-f^) n (1-^)- 

l<i<j<n •' l<r<s<n 

Giving /3 = (/3i,...,/3„) G Z", set /S^^) = (/3i, /3^J and /3(p) = (/3^^+...+^^_^+i, for any 
p = 2, ...,r. The number of decompositions 

P= ^ ai^j{ei - Ej) - ^ 6r,s(£r+£s) 
l<2<j<n l<r<s<n 

with a,j j and some positive integers is finite. Thus is well defined and belongs to £„. We introduce 
the linear maps 

^ ^, • • ■ '\ X^'^T.G 'I x^^/iG (18) 



^ Sri ■ X^ ^'^'^ 'i^ x'^ (5""'^ • 

Note that these maps are not ring homomorphisms. 

Lemma 4.1.3 Let K — [fci,...,fcm] C {!,..., n\ he the interval containing the m consecutive integers ki < 
• • • < km- Then for any a £ Z™ we have Hci^xx'^l • • • ^tZ^ ~ 

Proof. To simplify the notation we set Xk^ ~ Hi for any k = 1, ...,7/1. The linear map He is not a ring 
homomorphism. Nevertheless, if Pi, ....Pfc are polynomials respectively in the indeterminates yi, we 
have 

Hg(A(2/i) • • • PkiVm)) - Hg(Pi(2/i)) • • • HG(Pfe(2/„)) 
by linearity of Hg • We can write 

and by the previous argument 

HG(<5K(a)) = ^ (-l)^''^'ft-Qi_cr(l) + l ■ • ■ (^Q,„-CT(m)+m + /ia„-cr(m)-m+2) = 

where the last equality follows from (|16|l . By H17|l we have (5if(Q;) = Skv"- Thus by applying Hg to this 
equality we obtain RoiSKU"') = Uq ■ ■ 

Proposition 4.1.4 FFe have 

(i) : Uc._„ = Hg o A^, (u) : H^ Ug o V and (in) : Ug = Ug o V o 

Proof, (i) : Consider /? G Z". If Pi,...,Pk are polynomials in the indeterminates belonging respectively 
to the sets {xi^ \ ii € Ki}, {xi^ \ ir G Kr} we have as in the proof of the previous lemma 

HG(Pi---Pfc)=HG(Pi)---HG(Pfe). 
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Since A^(a;'') — Sk-^^x^^ ' . . . Sk^^^' ' where the polynomials 6KpX^^''\p = 1, are respectively in the 
variables {xi-^ \ ii £ Ki}, {xi^, \ ir G if,.} we can write 

Hg o A,ix^) = RaiSK^x^'"') ■ ■ ■ RaiSKy''). 

By applying Lcmma l4.1.3l we derive Hq o Ajj{x'^) — u^(-l) ■ ■ ■ — ^Cr^ix^^)- 

(ii) : Consider the linear map 

1 X^ ^ 5 ■ X^ 

Then by Lemma [4.1. HI applied with K = {1, n] we will have Hq o A = Ug- Now for any /3 G it is clear 
that AoV[xf^) ^ xf^ . This implies that Ug o V(a;'') = Hg o A o V(2:'3) = ]Ig{x'^) for any /3 e and (ii) is 
proved. 

(iii) is a straightforward consequence of (i) and (ii). ■ 
Now we have the equality 

6-^-5,= n n (i-^r^ (19) 

where E^i ~ Ll2<p<r{ih j) | 1 < * < »/i + ■ • ■ + Vp-i < J ^ "■}■ In particular (5^^ • 5n belongs to £„. Set 

S'^-Sv= J2 Q^^P)"""- (20) 

Let /i = (/i(^\ /i'^'')) be a r-tuple of partitions such that /x^*"') belongs to "P,,^ for any k = l,...,r. For 
G = S02n+i, Sp2n Or S02n, the Littlewood- Richardson coefficients rf^^, ^(^^ are defined by the equality 

oG . . . „G _ jA G 

This means that the coefficient d^^j ^(^, gives the multiplicity of the irreducible G- module V^{X) in the 
tensor product l/''(/i(-'^') ® ■ • • ® ^''(/i'^''^) thus is a nonnegative integer. 

Proposition 4.1.5 With the above notation we have 

= 5](-l)^(-)Q''(aoA-M) 

where fj, G N" is obtained by reading successively the parts of the partitions iJi^^\ defining fi from left 

to right. 

Proof. By (iii) of Proposition 14.1.41 we have Ug,?; — Ug o V o A,,. Since V o A,,(a::^) = (5^^ • (5,, • a;^, we 
obtain by 

Now by using Lemma l4 . 1 . 21 we derive 

^^a. • • -^(^) - E E(-l)'^^^2"(aoA-M)^? 
and the proposition is proved. ■ 

Remark: When fi — (/i*-^-*, is a r-tuple of partitions such that fi e N", we recover from the above 

proposition that the coefficients ^(,.) do not depend on the Lie group G = S02n+i, Sp2n or S02n 

considered. 
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4.2 A duality for the coefRcients d^j^) ^(^) 

We define the involution t on Z" by setting ■•■,/3„) = (—/?„, — for any (i = (/J^, ...,/?„) G Z". Let 
77 = (?7]^, be a r-tuple of positive integers summing n. Set 77 = (77^, ...,r7i). 

Lemma 4.2.1 for a??.?/ /3 = {Pi, ...,/3„) G Z" we have 

where and Q'' are respectively the partition functions defined in flO\) and ^20\) . 

Proof. By abuse of notation we also denote by l the ring automorphism of defined by /,(a;'^) = x''^^\ 
By applying l to the identity 



we obtain 



where = ^2<p<r{{i,i) \ l<i<~li + -- ■ + r]p-i <j< n}. This implies Q''(/3) = for any /3 e Z". 

■ 

Given a € Sn, denote by a the permutation defined by 

a{k) = a{n - k + 1). 

For any i G {1, n — 1}, we have Si — Sn-i- The following Lemma is straightforward: 

Lemma 4.2.2 The map a a is an involution of the group Sn- Moreover we have a(t(/3)) = i{a{l3)) and 
i{a) = i{a) for any PeZ'\a eSn- 

Lemma 4.2.3 Let A, fi two partitions of length n and a £ Sn- Then 

(-l)^(-)Q"(a(A + p)-{^i + p)) - +P)- {i{p) + P)) 

Proof. It suffices to prove the identity 

Q"(a(A + p)-{^i + p)) = V^{a{L{\) + p) - {l{p) + p)) 
Set P = V'^{^{l{X) + p) — {i-{p) + p))- From the above Lemma we deduce 

P = V^{i{a{\)) +a{p) - i^il^) - P)- 
Now an immediate computation shows that a{p) — p = i(cr(/9) — p). Thus we derive 

P = V^iaiX + p)~p~p))^ Q^{a{\ + p) - ^ ~ p) 
where the last equality follows from Lemma [4. 2. II ■ 

Consider \ £ Vn and fi = {p'^^\ p'^^^) a r-tuple of partitions such that p^''^ belongs to "P,,^ for any 
k = 1, ...,r. Recall that p G N" is the n-tuple obtained by reading successively the parts of the partitions 
/i^^-*, defining /x from left to right. Let a be the minimal integer such that 

A = (a — A„, a — Ai) and p = {a — ...,a — pi) (21) 
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belong to W\ Then A is a partition of length n. Set 1] = {rji, ■■■,T]r) ^^'^^ denote hy p, = {'fl'"^\ the 

r-tuple of partitions such that /i'-^^ — {^i, fijj^) e Prj^ and fl'^^^ = (Mtj^h h^^+i' A^^i+---+>Tp) ^ ^'Jp 

for any k = 2, ...,r. The following proposition shows that the Littlewood-Richardson coefficients d^(i) (r) 
defined above are branching coefficients associated to the restriction from the orthogonal group S02n to the 
subgroup SOri — SO^^ x • • -SOj^^ defined in 12.31 

Proposition 4.2.4 With the above notation, we have for any integer k > ^ ^'^ 

= [^(^ + M^""-^" : + fc«)^^]. (22) 
Proof. It follows from the definition of c?^(i) ^(^) and the above lemma that 

^'(^'.....M"-) = E i-^Y^^^Q^H^ + p)-f,-p) = J2 (-i)'<^)^^(^(^(A) + p)) m + p)). 

Then by Lemma ET^ we obtain 

<(^),...P<^) = E (-1)'^'^^^>(KA) + p)) - (.(a.) + p)). 

We have cr(;,(A) + p + ok) = cr(t(A) + p) + ok since a Sn and k = (1, 1). So we can write 
<(^....M<-> = E (-1)'^"^^>(^(A) +aK + p)) {i{p) + an + p)). 

Since A = i(A) + an and /i = + ok we derive 

= E (-1)'^^^^>(A + P) - + P)). 

Now by using Lemma [2.1.11 with Ad = and Proposition 12.3.11 we obtain 

J2 {-IY'-''^P^{<t(X + p)~ip + p)) - [V(X + /ck)^o^" : Vifl + k^f^-] 

for any integer k > ^'^^ ^ = and the Proposition is proved. ■ 

Remarks: 

(i) : The previous proposition can be regarded as an analogue for the Lie groups 5*0271+1, Sp2n and S02n of 
the duality 

c^(^),...,M'-)=[^W''"^^('^)'''^"] (23) 

between the Littlewood-Richardson coefficient c^^i) ^j^, giving the multiplicity of ^(A)'^^" in the tensor 

product y*^^" (g) ■ ■ ■ (g) V'^^'^{p^-^^) and the branching coefficient of the restriction of V{X)'^^" to the 
Levi subgroup GL^ = GL^j^ x ■ ■ ■ x GLri^ . Note that this duality can be proved by similar methods than 
those used in this paragraph starting from Jacobi-Trudi's determinantal expression for the Schur function 
s^^" = char(y<='-^"(A)) instead of (HHJl. 

(ii) : When all the pP'^ 's are row partitions, (|23|l simply express the Schur- Weyl duality between the dimension 
of the weight space p in y'^^" (A) and the multiplicity of y^^'> (A) in the tensor product of the symmetric 
powers of the vector representation of GL„ associated to p. Similarly, in this particular case, (|22|l reduce to 
the duality already observed in [TT] . 
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4.3 Quantization of the coefficients d^(^^ ^(^j 

Consider A G "Pn, ry = {rji, ...,77^) a r-tuple of positive integers summing n and fi = (/i'-^-', ...,//*■''•') a r-tuple of 
partitions such that /x^'^^ belongs to 7-"^^ for any A: = 1, r. We have seen in paragraph ia. ll that it is possible 
to define natural g-analogues of the Littlewood-Richardson coefficients c'^^^ ^j^, from the duality 123|) by 
setting 

= (24) 

where the polynomials Kf^'^^'^q) are the generalized Lusztig g-analogues of Definition lH . 1 . H When the /i^'^^'s 
are rectangular partitions of decreasing heights, the polynomials c^(i) ^(r) io) have nonnegative coefficients 
by Theorer ri3.1.2l It is tempting to define g-analogues of the coefficients d^jij ^(^) by setting 

cres„ 

where the g-partition function Q^' verifies 

(ij)e-E„ ^ (r,s)eE„ /3eZ" 

Unfortunately the polynomials ^(r) (<z) have not nonnegative coefficients in general. This is in partic- 

ular the case for A = (1, 1, 1, 0, 0), /z^^^ = (5), /x^^^ = (4, 4) and fi^^^ = (2, 2) where we have d^^r) (2) o) (9) = 

4.4 The g-analogues 2)^;5,...,^w (?) 

For G = 502n+i, Sp27i or SO271, there exist coefficients associated to the decomposition of a tensor product 
of G-modules into its irreducible components admitting a natural quantization with nonnegative coefficients. 
For any partition v write 3J*^(zy) for the restriction from the irreducible GLAr-module of highest weight 

v to G. Consider rj = {rji, rj^) a r-tuple of positive integers summing n and fi = {fJ,^^\ ^'■'"'') a r-tuple 
of partitions such that /x^'"') belongs to for any fc = 1, r. Given A G Vn, the coefficients ^(r) are 

defined as the muhiplicities of F'^(A) in 23<^(/x(i)) (g) • • ■ (g) QJ'^(^('')), that is we have 

x AG 

Contrary to the coefficients d , the coefficients D J^) depend on the Lie group G considered. 

Set 

r ni<.<.<„(l-^)forG = 5p2„ 
f^''^ ni<.<.<„(l-^;^)forG^502„ 

I ni<.<.<„(l - ^) ni<.<„(l - T^) for G = S02n+i 

Denote by Q^'^ the partition function defined for G = Sp2n, S02n and S'02ji+i by the identities 

n (25) 

where E^, = U2<j,<r{(i, j) | 1 < « < »/i H h r/p_;^ < j < n}. 

Proposition 4.4.1 FFzi/i i/ie abowe notation we have 
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Proof. Consider m 6 N and for any a — {ai, am) set 



Va = det 



I "cti "-ai + l 



-m+2 



"•Q2+m-2 



^GL„ 



I 



As in Lemma 14.1.21 we have from Jacobi-Trudi's determinantal expression of the Schur function s 

_ J (— l)^('^)s^^" if there exists ct £ 5„ and A e such that a o a = \ 
otherwise 



(26) 



Let K = [fci,...,fc„j] C be the interval containing the m consecutive integers fci < • • • < km- 

Consider the Laurent polynomial Oa' = ni<i<j<m(l ^ ^f^) (^^^ DaragraDh l4.1|l Then we derive as in Lemma 

14.1.31 the equality HGL„(5i<' • a^") = i'q- Now observe that for any integer fc, we have h 



SPi, 



= - /i^j^l" and = - /ife_r+'. This permits to express the determinant ^ in 

terms of the ft-fc^"", A: e Z. Set 

For any /? = (/3j, ...,/9„) G Z" and for each Lie group 5*^211, S02n+i and S02n we will have 

Now we define the intervals Ki, X,, of {1, n} from 77 by setting Ki = [1, i]^] and for any p — 2, r, 
i^p = [r/i + • • ■ + rip_i + 1, r/i + ■ ■ ■ + rj^]. Consider the linear maps 



and 



where D,, = O/f ^ • • • dx,. and /3(^\...,/3(''^ are defined as in (|18(l . Then we obtain as in Proposition 14. 1 the 
identities = Hgl„ ° Hgl„ = Ug o ^''^ which lead to V,, = Ug o ^''^ o By (jSHl we have 



Gn-1 



thus we can write Yr,{x'') = UgIEJjgz- = E^sgz- Then by using the straight- 

ening law H2()|l we derive 



GL„ GL 



which establishes the proposition. 



The coefficients S J^^ admit the natural quantization 



o-GS„ 



where H^'*"^ is defined for G = Sp2n, SO271 and S02n+i respectively by the identities 

Uu,)eE,M - ^ft)"' ni<.<.<„(i - Qi^)-' = E,Gz^ nfp^-Wxf^ 



l(ij)6-E„ 



;i - i^r' ni<.<.<„(i - q^r' = e.gz^ n^-^^^- (/?) 



n 



(27) 
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There exists a duality between the polynomials S^J^ ^(1-) (?) ^^'^ g-analogues of Theorem 13.2.41 Sur- 
prisingly this duality does not relate the polynomials S^;^^ ^'^ polynomials K?'j{q) but to the 
polynomials K^'^{q) where 

{Sp2n if G = S02„ 
S02n if G = Sp2n 
S02n+l if G = S'02n+1 

The polynomials ^(r) (?) a-lso decompose as nonnegative combinations of Poincare polynomials. Set 

77 = (t^]^, 77^). Then G and GL„ contain Levi subgroups Lqj and Lgl^J isomorphic to GLjj^ x • • • x 
GLjj^. We have / = {0 < < 771} Ui<p<r-i {^i | ^1 + • • • + ?/p < « < ?/i + • • • + TJp+i}- 

Theorem 4.4.2 Wit/i t/ie previous notation we have 

®im,....p<.-) = = 9^ E [^(^)^ ^ Vi\f^-]K^^^^-'{q) (28) 

where A,/i are defined as in Theorem \4-.Z.4\ 

Proof. We use the notation of paragraph We only give the proof for G = SP2n or G = S02n- The 
proof is essentially the same for G = S'02n+i. By proceeding as in the proof of Lemma f4. 2. II we establish, 
for any /3 = (/J^, /3„) G Z", the identity 

We have 

®i'<^....,M<-) ('^) = E + P) - + P)) = E (-1)'^"^^? '(^'^(A + P) - (a^ + P))). 

Then the equality S^J^ ~ il) obtained by using essentially the same arguments as in the 

proof of theorem 14. 2. 41 

We deduce from the expansions 

n (l-9^)-i=gl*l/^E^50.„W:.-^and n (l-'Z^)-^=?l'l/^E-^P-('5)^"'- 

l<r<s<n (5eN" l<r<s<n iSN" 

Consider /3 £ Z". By proceeding as for Lemma [3. 2. 31 we derive from (|27|l the equality 

5eN",|<5| = -|/3 

This implies the decomposition 

o-e5„ (5eN'M5| = -|/3| 

where (3 = a{X + p) — (p + p) in the second sum. Since = |A| — , we have 

^(.,(9) E(-l)'^"^ E rg(J)7',«^"'^(a(A + p + a-i(<5))-(^ + p)) 

o-e5„ i56N",|(5| = |ai|-1A| 
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For any ct G 5„, we have a ^(N") — N" and rg((5) — r^{(j[6)). Thus we obtain 

ceSr, <5eN",|(5| = |^i|-|A| 

5GN",|i5| = |ai|-|A 

Now by Lemma r^.2.21 Kf^g'^{q) = or there exits a € S„ and v € Vn such that v ~ cr^^ o (A + (5). 
Since A + (5 has positive coordinates, v cannot have negative coordinates and thus v G Vn- Then we have 
\v\ = |A| + |(5| = and S = (j{v + p) — p — X and it follows that 

2^i^^,...,,<.,('^) = ^'^ E E(-i)'^^^-G(-(-+p)-p-A)At^-'(^)- 

Now we deduce from Lemma [2.1.11 applied with A4 = and Proposition 12 . 2 .31 that the equality 
(-1)'^"^^g(^('^ + p) - (A + p)) = [V{i^ + knf : V{X + knf^-] 

holds for any integer k > '^^^^''^ — -L^^^-^-L^. Since A and v are partitions, we can write [V{h' + kn)^ : 

F(A + /eK)'^^"] = [l^(i')'^ '■ V{\)'^^"] (see Remark after Proposition l2.2.3|l . this yields to the desired equality. 
■ 

Remark: By setting gr = 1 in the above identity, we obtain the identity 

which can also be deduced from the decompositions 

and 

since we have the duality [V(z/)'^^"" : V{X)'^] = [V{X)^ : V{i^)^^"] (see Theorem Ai of JTJ). 

When the /^'■'"'^'s are rectangular partitions of decreasing heights, S^J^^ ^^(r) io) has nonnegative coefBcients 
by H23|l and Thcorcm l3.1.3l From the above theorem and Q we obtain 

E E (29) 

where 

r (1,1) ifG = 502„ 

Og ={ (2) if G = Sp2n 

[ (!) if G = S02n+1 

For completion, set ^(r) (<?) = -^^^"'^(9) a-nd '^gl„ — 0- Then the four families of polynomials 

^"^(1^ (r) (9) can be classified by using the same symbols <0g = 0, (1), (1, 1), (2) labeUing the four families 
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of stable one-dimensional sums. Write X^^^^'^ (q) for the one-dimensional sum defined from the affine 
crystal of kind <0g associated to /i^^', ^^''^ and A. By Theorem 13.1 .HI we know that X'^lf-^ fj,{r)il) ~ 
K^j^"'^ (q). Then we derive from H29(l and Theorem 14 . 4 . 21 that Conjecture 5 of ^J] giving the decomposition 
of the one-dimensional sums of kind (}c = (1), (1, 1), (2) in terms of those of kind can be reformulated as 
follows: 

Conjecture 4.4.3 The q- analogue D'^^^f^ fj,(r)il) coincide with the stable one-dimensional sum X^l^^'^ (?) 
up to the multiplication by a power of q : 

where q* is a power of q depending on the normalization of the energy (or co-energy) function chosen on 
this crystal. 

Remark: This conjecture has been proved in ^2] when /i are row partitions of decreasing lengths. 

In this case the stable one-dimensional sums are stable limits of Lusztig g-analogues. Accordingly to the 
previous conjecture, the stable one-dimensional sums associated to nonexceptional affine Lie algebras are 
stable limits of generalized Lusztig g-analogues. 

5 Question 

In Theorem l4.4.2l the partitions /i*-^-*, are not supposed rectangular. Conjecture 13. 1 .41 suggests that it 

should exists, for all classical Lie groups, nonnegative g-analogues S^J^ ^{r) il) of tensor product coefhcients 
defined from the r-tuples fj, = (/i^^^ /i'^''^) such that /i is a partition. It would be interesting to find a 
combinatorial interpretation of the p(>-) (?) when fi^^'' are not rectangular. 
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